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(57) Abstract 

A computer Input device (42) detects images on a 
surface (116). The computer input device (42) generates . 
input infonnation indicative of a change event when the 
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present invention can also be directed to a mediod of • 
using die input device (42) or printable medium with 
the predetermined patterns dispcned thereon. 
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IMAGE SENSING OPERATOR INPUT DEVICE 

BACKGROUND OF THE INVENTION 
The present invention relates to an input device 
for a computer system. More specifically, the present 
5 invention relates ta an input device for providing 
position information to the computer system based on 
movement of the input device. 

A traditional computer input device, such as a 
mouse, includes a housing, with a ball mounted in the 
10 housing. The ball is either configured in a 
traditional manner in which/ in the normal work 
position, the ball engages a work surface and rotates 
based on the user's movement of the mouse across the 
work surface. The ball may also be provided as a 
15 track ball, which is rotated by digital manipulation 
from the user. In either case, position encoders are 
used to detect rotation of the ball iii the mouse, and 
to provide position informa:tion indicative of that 
rotation to the computer. : In many instances, the 
20 position information is used to control movement of a 
visual image (such as a mouse cursor) on the display 
screen of the computer. 

Also, in one prior device, a mouse is configured 
with the track ball arrangement described abovie. the 
25 track ball is preprinted with a uniform predetermined, 
image. A charge coupled device is used to. detect the 
image on the track ball and detect movement of the 
image . Movement of the predefined image is used to 
provide position information to the computer. 
30 However, the prior computer mouse which uses the 

charge coupled device configuration has a number of 
significant, disadvcintages . First, the riBaction time 
of charge coupled devices is quite slow. In addition. 
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processing an images signal from a charge coupled . 
device is computationally intensive and takes a 
relatively large, and expensive processor. Also, 
-charge coupled devices are highly sensitive to 
5 saturation. In other words/ if the ambient light 
conditions are variable, charge coupled devices do not 
perform well. In addition, if an extraneous light 
sfpurce, such as a relatively bright light, is directed 
toward the image producing surface, the charge coupled 
10 devices can easily become saturated and their 
performance then quickly degrades. 

Further, another. prior computer mouse- 
. commercially available from Mouse Systems of CA 
included a mouse with an LED which was used in. 
15 conjunction with a mouse pad having a predetermined, 
uniform pattern thereon. The pattern was formed by a 
uniform grid of blue and red lines. The e;raissions 
from the IJED:was reflected off of the mouse pad to a 
detector which provided an analog output signal. The 
20 signal was in the form of a waveshape with peaks 
■ corresponding to the different colored grid lines. 
From this: waveform, the lines were counted and 
interpolated to obtain position information. Such a 
mouse system requires a mouse pad with a speqial 
25 uniform pattern implemented thereon. 

In addition, typical mouse pointing devices are 
operated using a fixed scale and resolution. A fixed 
scale means that the mouse must always be inoved a 
given distance over a work surface in order to move 
30 the cursor image on the computer screen a given nunA)er 
: of pixels. For example, in order to move the cursor 
by 200 pixels on a computer screen having a resolution 
of 200 dots per inch (dpi), the mouse must be moved a 
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. fixed distance over the work surface, . such as two 
inches. Each time the mouse is moved two inches, no 
matter what surface it is moved over, that movement 
will always correspond to movement of the cursor image 
5 by 200 pixels. 

Fixed resolution refers to the resolution of the 
computer scireen for which the smallest detectable 
discrete movement of the mouse will change the cursor 
position on the computer screen by only a single 

10 pixel. For example, some conventional mice have a 
resolution generally in the range of 200-400 dpi. 
This means that the smallest discrete movement of the 
mouse which is detectable by the position encoding 
mechanism in the mouse will change the cursor position 

15 on the display screen by only a single pixel ; for 
screens having a resolution in the range of. 200-400 
dpi. However, if the computer screen has a higher 
resolution, such as 1200 dpi, the smallest detectable 
discrete movement of the mouse may cause the cursor 

20 image to move 4-6 pixels on the display screen. Some 
current mice, , with highly accurate position encoding 
mechanisms, can achieve a resolution of 1200 dpi. 

Ab stated above, the scale and resolution of 
conventional mouse pointing devices are fixed. in 

25 order to change the scale or resoiution, the user is 
typically required to load a different mouse driver 
which modifies the beha.vior of the mouse to change the 
resolution or to change the scale. Alternatively, a 
user cain also use a separate control panel applet to 

30 trigger the software device driver to change the scale 
and resolution. Using a control applet to change 
scale or resolution can be quite cumbersoitie. ; 

In some applications, items to be selected on the 
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screen are quite small. Therefore, it can be 
difficult to select items when a high resolution 
monitor is used. In some instances, a single pixel 
offset can change the. selection from one targeted item 
5 (or Option) to another. One method which can be used 
to overcome this difficulty in such applications is to 
maintain the resolution euid magnification of the 
computer screen at its nominal level and to decrease 
the resolution of the pointing device • However, as 

10 indicated above, conventional methods for changing the 
resolution of the pointing device can be quite 
cumbersome, particularly when a user desires to change 
the resolution a number of times while operating 
within a single application. 

15 . . " . ... SUMMARY OF THE INVENTION 

A computer input device detects images on a 
surface. , The computer input device generates input 
information indicative of a change event when the 
device switches from reading one predetermined pattern 

20 to reading another predetermined pattern. The present 
invention can also be directed to a method of using 
the input device or printable medium with the. 
predetermined patterns disposed thereon. 

BRIEF DESCRIPTION OF THE DRAWINGS 

25: FIG. 1 is a block diagram of an exemplary 

environment for implementing an input device in 
accordance with the present, invention. 

FIG. 2 A is a functional block diagram of a 
computer and an input pointing device as used in one 

30 embodiment of the present invention. 

FIG. 2B illustrates a packet of information 
generated: by an input pointing device JEor transmission 
to the comjputer. 
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FIG. 3 illustrate^. a computer input device, shovm 
in partial sectional and partial block diagram foann, 
in accordance with one embodiment of the present 
invention. . 
5 FIG. 4 is a block diagram illustrating use of the 

pointing device shown in FIG. 3 in conjunction with a 
mouse pad or work surface having a predetermined 
pattern thereon . 

FIGS. 5A and 5B illustrate operation of the input 
10 device in recognizing the predetennined pattern shown ; 
in FIG. 4. 

FIG. 6 illustrates a mouse pad or work surface 
having a variety of predetermined patterns disposed 
thereon for providing an input device with a variable 
15 resolution. 

FIG. 7 is a, view of a mouse pad or work surface 
having predetermined coded images disposed thereon. 

FIG. 8 is a diagram which illustrates projection 
of the predetermined coded images on an X-Y coordinate 
20 system. 

FIG. 9 illustrates a packet of information 
generated by an input device in accordance with one 
embodiment of the present invention. 

FIGS. lOA and lOB represent a flow diagram 
25 illustrating operation; of an ii>put device in . 
accordance with one embodiment of. the present 
irivention using the data packet illustrated in FIG. 9. 

FIG. His a block diagram illustrating the use of 
an input device to provide specialized raeissages to the 
30 computer in accordance with another embodiment of the 
preseint invention. 

FIGS. . 12A and i2B represent a flow diagram 
illustrating the operation of the input device shown 
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FIG. 13 is a flow diagram illustrating the 
operation of >n application in conjunction with an 
input device in accordance with another embodiment of 
5 the present invention in which the application 
generates a sheet having application specific images 
disposed thereon. 

FIG. 14 illustrateis another mouse pad or work 
surface having a variety of patterns or images 
10 disposed thereon. 

FIG.; 15A is a functional block diagram 
illustrating the use 6f an input device in a learn 
. mode in accordance with another embodiment of the 
present' invention. 
15 FIG. 15B illustrates one illustrative embodiment 

of an orientation compensating code. 

?IG. 16 is a flow diagram iliustrating operation 
of an input device and computer in a learn mode ih 
accordance with one embodiment , of the present 
20. invention. 

DETAILED DESCRIPTION OF THE ILLUSTRATIVE EMBODIMENTS 
The present invention provides a user input 
device for generating position information and 
providing that information to a computer system. The 
25 position information is generated based on detected 
movement of the user input device, or a portion 
: thereof. The moverhent is detected by identifying a 
pattern or image on a surface movable relative to the 
user input device and monitbrihg relative movement of 
30 the pattern. 

Overview 

FIG. 1 and the related discussion are intended to . . 
provide a brief, general description of a suitable 



WOOO/38103 



PCT/US99y30507 



computing environment in which the invention may be 
implemented i. Although not required, the invention 
will be described, at least in part, in the general 
context of computer- executable instructions, such as 
5 program modules, being executed by a personal cotnputer 
or other computing device. Generally, program modules 
include routine programs, objects, components, data 
structures, etc. that perform particular tasks or 
implement particular abstract data types. Moreover, 

10 those skilled in the art will appreciate that the 
invention may be practiced with other computer system 
configurations, including hand-held devices, 
multiprocessor systems, microprocessor^based or 
programmable consumer electronics, network PCs, 

15 minicomputers, mainframe computers, and the like^ The 
invention is also applicable in distributed computing 
environments where tasks are performed by . remote . 
, processing devices, that are linked through a 
communications network. In a distributed computing 

20 environment, program modules may be located in both 
local and remote memory storage devices. 

With reference to FIG. 1, an exemplary' 
environment for the invention includes a general 
purpose computing device in the form of a conventional 

25 personal computer 20, including processing unit 21, a 
system memory 22, and a system bus 23 that couples 
various system components including the system memory 
to the processing unit 21. The system bus 23 may be 
any of several types of bus structures including a 

30 memory bus or memory controller, a peripheral bus, and 
a local bus using any of a variety of bus 
architectures. The system memory includes read only 
memory (ROM) 24. a random access memory, (RAM) 25. A . 



wo 00/38103 



PCT/US99/30507 



basic input/output 26 (BIOS), containing the basic 
routine that helps to transfer information between 
elements within the personal computer 20, such as 
during start-up, is stored in ROM 24. The personal 
5 computer izo further includes a hard disk drive 27 for 
reading from and writing to a hard disk (not shown) , a 
magnetic disk drive 28 for reading from or writing to 
removable magnetic disk 29, and an optical disk drive 
3 0 for reading from or writing to a removable optical 

10 disk 31 such as a CD ROM or other optical media. The 
hard disk drive 27, magnetic disk drive 28, and 
optical disk drive 30 are connected to the system bus 
23 by a hard disk drive interface 32, magnetic disk 
drive interface 33, and ah optical drive interface. 34, 

i5 respectively. The drives and the associated computer" 
readable media provide nonvolatile storage of computer 
readable instructions, data structures, program 
modules and other data for the personal computer 20, 

Although the exemplary, environment described 

20 herein employs a hard disk, a removable magnetic disk 
29 and a removable optical disk 31, it should be 
appreciated by those skilled in the art that other 
types of computer readable media which can store data 
that ii3 accessible by a computer,: such as magnetic 

25 cassettes, flash memory cards, digital video disks, 
Bernoulli cartridges, random access meraiories (RAMs) , 
read only memory (ROM) , and the like, may also be used 
in the exemplary operating environment. 

A number of. program modules may be stored on the 

30 hard disk, magnetic disk 29, optical disk .31, ROM 24 
or RAM 25, including an operating system 35, one or 
more application programs 36, other program modules 
-37, and program data 38. A user may enter commands 
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• and information into the personal computer 20 through 
input devices such as a keyboard 42 and pointing 
device 40. Other input devices (not shovm) may 
include a microphone, joystick, game pad, satellite 
5 dish, scanner/ or the like. These and other input 
devices are often connected to the processing unit 21 
through a serial port interface 46 that is coupled to 
the system bus 23, but may be connected by other 
interfaces, such as a sound card, a parallel port, a 

10 game port or a universal serial bus (USB). A monitor 
47 or other type of display device is also connected 
to the system bus 23 via an interface, such as a video 
adapter 48. In addition to the monitor 47, personal 
coraputeris may typically include other peripheral 

15 output devices such as speaker 45 and printers (not 
shown) . 

The personal computer 20 may operate in . a 
networked environment . using logic connections to one 
or more remote computers, sucih as a remote computer 

20 49. The remote computer 4 9 may be another personal 
computer, a server> a router, a network PC, a peer 
device or other network node, and typically includes 
many or all of the elements described above relative 
to the personal computer 20, although only a memory 

25 storage device 50 has been illustrated in FIG. 1. The. 
logic '' connections depicted in FIG .1 include . a local 
are network (LAN) 51 and a wide area network (WAN) 52. 
Such networking environments are commonplace in 
offices ; enterprise-wide cojmputer network intranets 

3d and the Internet. ^ 

When used in a LAN networking environment, the 
personal computer 20 is connected to the local area 
network 51 through a network interface or adapter 53. 
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When used in a WAN networking environment, the 
pjeirsonal computer 20 typically includes a modem 54 or 
other means for establishing communications over the 
Wide area network 52, such as the Internet. The modem 
5 54, which may be internal or external, is connected to 
the system bus 23 via the serial port interface 46. 
In a network environment, program modules depicted 
relative to the personal computer 20, or portions 
thereof, may be stored in the remote memory storage 

10 devices* It will be appreciated that the network 
connections shown are exemplary arid other means of 
establishing a communications link between the. 
computers may be used. 

For a better understanding of the present 

15 invention, a brief discussion of mouse message 
processing is now* provided. FIG. 2A is a functional 
block diagram of computer 20 used with input device 42 
in accordance with one embodiment of the present 
invention. Mouse 42 illustratively has right and left 

20 buttons and a depressible, rotatable wheel 103 there 
between. The block diagram of computer 20 shown in 
FIG. 2A includes a number of the items discussed with 
respect to EIG* 1, and those items are similarly 
numbered. However, the block diagram in FIG. 2A also 

25 shows a number of components in greater detail which 
: are used in processing a mouse message. Computeir 20 
includes mouse driver 60, message : hook jprocedure 62, 
and focus application 64. To better understand the 
operation of input device 42 in computer system 20 

30 shown in FIG. 2A, the components of that system are 
discussed in connection with a data structure 
illustrated in FIG. 2B. 

FIG. 2B illustrates a four-byte mouse packet 66 



wo 00/38103 



PCTAJS99/30507 



in a row and column foinnat with bytes 68/ 70/ 72, and 
74 shown . in rows and the individual bits of each byte 
shown in columns. Byte 68 is the first byte provided 
by input device 42, byte 70 is the second byte, byte 
5 72 is the third byte, and byte 74 is the fourth byte. 
The columns of bits are organized with the least 
significant bits on the far right and the most 
significant bits on the far left. Thus, column 76 
includes the least significant bits of each of the 

10 four bytes and column 78 includes the most significant 
bits of the four bytes. 

Within mouse packet 66, first byte 68 includes 
left button bit 80, right button bit 82, and middle 
button bit 84. A one in the left button bit 80 

15 indicates that the left button is depressed and a zero 
in left button bit 80 indicates the left button is not 
depressed. Similarly, a one in the right button bit 82 
or middle button bit 84 indicates that the right 
button or the middle button, respecrtively, are 

20 depressed and a zero in either of these bits indicates . 
that their respective button is not depressed. \ 
Fourth bit 86 is set to a one. 

Fifth bit 88 of byte 68 is the ninth bit of a 9- . 
bit signed value that is completed by byte 70 . The 9- 
25 bit value produced by the cdmbination of bit 88 and 
byte 70 . represents . the direction and magnitude .o£ 
movement of the mouse along the k-coordinate. Since 
the 9 -bit. value is in two's complement format, bit 88 
. indicateis the direction of mouse movement such that if 
30 it has a value if zero, mouse movement is in a 
positive X direction and if it has a value of orie, 
mouse movement is in the negative X direction. 

Sixth bit 90 of first byte 68 is the ninth bit of 
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a 9-bit signed value that is completed by byte . 72 . 
The combination of bit 90 and third byte 72 produces a 
value that indicates the magnitude and direction and 
movement of the mouse along the Y coordinate . Since 
5 this value is a two ' s complement signed value, bit 90 
indicates the direction of movement along the Y 
coordinate such that if it has a value of one, the 
mouse movement is in a negative Y direction and if it 
has a value of zero, the mouse movement is in a 

10 positive Y direction. 

Seventh bit 92 and eighth bit 94 of first byte 68 
indicate whether the 9-bit valueis formed by bit 88 and 
byte 70 and by bit 90 and byte 72, reispectively, haye 
incurred an overflow condition. This occurs when more 

15 than nine bits of movement have been detected by the 
mousis. In thi is condition, the respective 9-bit value 
should be set to its maximum magnitude for the . 
direction of movement. 

The least significant four bits 96, 98, 100 and 

20 101 of fourth byte 74 represent the direction and 
magnitude of movement of wheel 103 (illustrated in 
FIG. 2A) . The value represented by bits 96-101 is ai 
signed value wherein a positive value indicates wheel 
motion toward the user and a negative value indicates 

25 wheel motion away from the user. . 

Bits 105 and 107 are the fifth and sixth bits of 

: byte 74, respectively, and indicate closure of 
switches corresponding t;o the left and right buttons, 
respectively, of mouse 42. Thus, when bit 105 has a 

30 value of one, the switch associated with the left 
button is closed indicating that the corresponding 

. . mouse button has been depressed. Bit 107 reflects 
closure of the switch associated with right mouse 
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button in a similar fashion. 

Bits 109 and 111 of fourth byte 74 are reserved 
for later use and are set to zero. Those skilled in 
the art will recognize that mouse packet 66 
5 illustrated in FIG. 2B and the serial interface 46 
described below are used in PS/2 and serial mouse 
connections. For universal serial bus (USB) 
connections, the mouse . information is sent to the . 
mouse driver using publicly available USB protocpls 

10 for mice. 

In order to describe the proqessing of a 
conventional mouse message, reference is made to both 
FIGS. .2A and 2B. To initiate a mouse message, the 
user firlst manipulates mouse 42. Based on this 

15 manipulation, mouse 42 generates a mouse packet that 
is passed to serial interface 46 and which is 
indicative of the manipulation event. When serial 
interface 46 receives mouse packet 66, it converts the 
serial information in mouse packet 66 into a set of 

20 parallel packets and provides the parallel packets to 
mouse driver 60. Mouse driver 60 creates a mouse 
message based on the manipulation event . The creation 
of the mouse message is identical to the manner in 
which existing mice create mouse messages. 

25 The. mouse message is. then transmitted to 

operating system 35. In one illustrative embodiment, 
operating system 35 is . a "WINDOWS NT®", a "WINDOWS . 
95®" , or a "WINDOWS 98®" , brand operating system 
(provided by Microsoft Corporation of Redmond, 

30 Washington). Operating system 35 includes a mouse 
message hook list that identifies a series of mouse 
message hook procedures 62. When operating system 35 
receives the mouse message from mouse driver 60, it 
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examines the mouse message hook list to determine if 
any mouse message hook procedures have registered 
themselves with operating system 35. If at least one 
mouse message hook procedure has registered itself . 
5 with operating system 35, operating system 35 passes 
the mouse message to the registered mouse message hook 
procedure 62 that appears first on the list , 

The called mouse message hook executes and 
returns a value to operating system 35 that instructs 
10 the operating system to pass the mouse message to the 
next registered mouse message hook. 

The mouse message may, for example, represent a 
command to an application, which owns the window 
currently under focus in computer 20. In that 
15' instance, the message hook procedure 62 issues the 
command to the focus window application. In response, 
the focus window application 64 performs the desired 
function. 

After the message hook procedure 62 issues the 
20 command to the focus application 64, the message hook 
procedure 62 consumes the mouse message by removing 
the message from the message chain. This is 
accomplished by returning a value to operating system 
35 which ihdiqates to the operating system that it 
25 should not pass the mouse message to any other . message 
hook procedures. 

FIG. 3 is a more detailed diagram, in partial 
block form and partial schematic form, illustrating an 
operator input device, such as mouse 42, in accordance 
30 with one embodiment of the present invention. Mouse 
42 includes housing 102, electromagnetic radiation 
source (which may simply be a light source such as an 
LED) 104, aperture 106 defined in the bottom ; of 
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housing 102, lens 108, image ipr pattern detector 110, 
cpntrolier 112, and current driver 114. In FIG, 3, 
mouse 42 is shown supported relative to work surface 
116. Pattern detector 110 can be any suitable 
5 detector which is capable of detecting images or 
pattertis from information carried by electromagnetic 
radiation impinging thereon and providing a signal 
indicative thereof, and may be an artificial retina 
pattern detector as described in greater detail below, 

10 for example . 

Light source 104 can be any suitable source of 
electromagnetic radiation which can be used to provide 
radiation for impingement on a pattern or image and 
which can then be detected by pattern detector 110. 

15 In one illustrative embodiment, light source 104 
Includes LED 118 and lens 120. Radiation emitted from 
an LED il8 is transmitted through lens 120 such that 
it passes through aperture 106 in housing 102 and 
impinges upon work surface 116 which can have a 

20 predetermined pattern or image thereon. The light then 
reflects off of work surface 116 toward lens 108. 
Lens 108 collects the radiation reflected from surfaced 
116 and directs it to image detector (e.g., artificial 
retina) 110. It should be noted that lens 108 can be 

25 eliminated with the addition of lenses on either LED 
118,: image detector 110, or both. Similarly, the lens 
can simply be . eliminated if the radiation is 
detectable by the detector, such that the image or 
pattern can be detected, without a lens. 

30 Image detector 110 generates an image signal 

indicative of an image or pattern on work surface 116. 
The image signal is; provided to controller 112 which, 
in. one illustrative embodiment, computes position 
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information based on the image signal. The position 
information indicates movement of mouse 42 relative to 
work surface 116, as will be described in more detail 
below. Position information is provided by controller 
5 112 in the form of an information packet, through an 
output such as a cable (not shown) , to. computer 20 
illustrated in FIGS. 1 and 2A. Mouse 42 may also 
provide the output from controller 112 through a 
wireless transmission link such as infrared 

10 ultrasonic, or radiofrequency links. In an 

illustrative embodiment, the position information 
provided by controller 112 i^ provided according to a 
conventional format, such as through a serial 
interface, a universal serial bus (USB) interface, or 

15 in any other stiitcJDle interface format. 

Image detector 110, in one illustrative 
embodiment, is an artificial retina manufactured by 
Mitsubishi Electric Corporation and includes a two- 
dimensional array of variable sensitivity photo 

20 detectors (VSPDs) which operates in a known manner. 
Briefly, the VSPDs are formed by a side-by-side pair 
of diodes integrated onto and separated by a semi- 
insulated GaAs layer (pn-np structure) . In one 
embodiment, the array is a 32x32 element array, but 

25 could be larger ; or smaller as desired. The photo . 
detector current depends, both in sign and magnitude, 
on applied vbltagie . i; Such VSPDs exhibit an analog 
memory affect which stores conductivity information 
when a voltage lis applied in the presence of an 

30 optical write pulse. This information is retrieved by 
injecting an optical readout pulse. 

Image processing in such devices is based on 
optical matrix- vector multiplication. An input image 
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is projected onto the device as a weight matrix. All. 
VSPDs have one electrode connected along rows, 
yielding a sensitivity control vector. Thus, the VSPD 
sensitivity can be set to arbitrary values in each row 
5 within a certain range. In addition, the remaining 
VSPD electrode is connected along columns, yielding an 
output current vector defined by the matrix vector 
product of the weight matrix times the sensitivity 
control vector. 

10 In an illustrative embodiment, image detector 110 

is controlled to perform edge extraction operations. 
The sensitivities of two adjacent detector rows are 
set to +1 and -1, respectively, whereas all other 
sensitivities are set at 0. In this embodiment, the 

15 output current is proportional to the difference in 
light intensities of the two active rows. By shifting 
the control voltage pattern in; a cyclical manner (0, 
+1, -1, 0, 0, etc.), the horizontal edges of the input 
. image are sensed. Thus, the system operates in a time 

20 sequential and semi-parallel mode . 

In one illustrative embodiment, mouse 42 also 
includes current driver 114 which is coupled to source 
104. In . that embodiment, controller 112 

intermittently senses? the intensity of the radiation . 

25 generated by source 104. and adjusts the current 
provided. to source 104 through current driver 114. In 
other words i if the sensed intensity is lower than a 
desired range, contirpller 112 provides a feedback 
.signal to current driver ll4 to boost the current 

30 provided to source 104 in ; order to increase the 
intensity of the electrbmagnetic radiation emanating 
from source 104. If, oh the other hand, the intensity 
of the radiatioh is . higher, than a desired range. 
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controller 112 provides the feedback signal to durrent 
driver 114 to reduce the current provided to source 
104 to thereby reduce the intensity of the radiation 
emitted from source 104. This may be done, for 
5 example, to reduce the overall power consumption of 
mouse 42 . 

PIGS. 4 and 5A-5B illustrate the operation of 
mouse 42 in accordance with one aspect of the present 
invention. Controller 112 includes A/D converter 122, 

10 control component 124, image matching component 126 
and image table 128. FIG. 4 also illustrates image 
detector 110 showing the 32X32 VSPD (pixel) array 123 
onto which the image from surf ace 116 is directed. The 
entire viewing area 123 bf image detector 110 is 

,l6 coincident with the 32x32 pixel array. However, 
defined within the entire viewing area 123, is sample 
area 125. Sample area 125 is smaller than the viewing 
area and includes, in orie illustrative embodiment, 
approximately a 10 pixel by 10 pixel areia centered 

20 generally around a center 127 of viewing area 123. In 
the embodiment shown in FIG. 4, thie image on surface 
116 is simply a grid pattern. 

In operation, controller 112 first activates 
source 104 such that radiation is impinged on work 

25 surface 116. Mouse 42 can operate on a surface haying 
a predefined pattern (such as the grid structure) or 

. without a predefined pattern. For example, 

substantially every surface has some irregularities or 
surface roughness, if only at the microscopic level . 

30 A commercially availcible artificial retina is capable 
of resolving images which are only a few micronis in 
size, assuming the light source is poweifful enough, 
thus, the radiation is reflected off of surface 116 
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back to impinge on viewing area 123, cariying with it 
information indicative of either a predetermined 
pattern on surface 116 or an image or pattern formed 
by the surface roughness on surface 116. 
5 In the embodiment in which controller 112 is not 

looking for a predetermined pattern on work surface 
116, the analog signal indicative of the pattern 
formed by the surface roughness of surface 116 is .. 
provided to A/D converter 122. A/D converter 122 
10 converts the signal into a digital value which is 
provided to control component 124 . Control component 

124 executes one of any number of suitable algorithms, 
such as the above -identified edge extraction 
algorithm, to identify a pattern or image from surface 

15 116 which is reflected oh sample area 125. .This 
information is stored by control component 124 in a 
memory associated therewith. Control component 124 
. then waits for a predetermined time out period which 
is illustratively determined based on a maximum 

20 expected velocity of the mouse over surface 116. In 
one illustrative embodiment, the time out duration is 
approximately 1-10 milliseconds. 

After the time out period, control component 124 
reactivates source- 104. (if . it has been de- activated) , 

25 and determines whether the image within sample area 

125 has moved. Movement of the . image within sample 
area 125 is indicative of relative movement between 
mouse 42 and surface 116. Based on detected movement, 
control Component 124 provides position information in 

30 a customary and acceptable format (such as packet 66 
illustrated in FIG. 2B) at an output (such as through 
a cable). This information is used for any number of 
things , including the moyement of a mouse cursor on 
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. the computer display. 

After movement of the image or pattern within 
viewing area 125 is detected, a new image or pattern 
within sample area 125 is detected. Image data, 
5 indicative of the new image, is then stored by control 
component 124 . Control component 124 then again waits 
for another time out period and determines whether the 
new image has moved. This process continues such that 
mouse 42 continues to provide position information 

10 indicative of the relative movement of mouse 42 and 
work surface 116. 

Detection of movement of the image in sample area 
125 can be accomplished in a number of fiashions. Such 
techniques include cross ^correlation, circular 

is harmonics, pattern moment characteristics, and chord 
histogram detection. Rotational movement of mouse 42 
with respect to surface 116 can also be detected, if 
desired. In one illustrative embodiment, lens 120 is 
shaped to transmit radiation in an elongate, or 

20 elliptical, pattern. Therefore, if the mouse is 
rotated, rotation of the elliptical shape can be 
detected as well . All of these techniques are 
described in greater detail in the aboye-identif ied . 
. co-pending U.S. patent application.: 

25 Controller 112 can also be conf igured to detect a 

predetermined pattern (such as the grid stxncture) 
within viewing area 123, and to detect movement of the 
predetermined pattern relative to mouse 42. For 
example, FIGS. 5A and 5B illustrate the movement of a 

3b predeterminisd pattern within sample area 125. In the 
embodiment illustrated in FIGS. 5A and SB, the 
predetermined grid pattern (shown with vertical lines 
only for the sake of clarity) is formed of alternating 
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blue and red lines such that the radiation reflected 
back to image detector 110 carries with it information 
of whether blue or red grid lines are within sample 
area: 125. Of course, the alternating grid lines could 
, 5 be formed of alternating thickness ^ of different 
shades, or have other distinguishing characteristics 
which allow control component 124, when it detects the 
image, to identify the alternating grid lines. 

In FIG. 5A, two blue lines 132 and 134 are 
10 within sample area 125, and one red line 136 is within 
sample area 125, between blue lines 132 and 134. 
. After movement of the mouse, a new pattern resides 
within sample area 125, as illustrated in FIG. 5B. 
The new pattern shows that lines 132, 134 iand 136 have 
15 shifted to the left relative to sample area 125, and 
that another red line 138 has entered the right side 
of sample area 125. 

The sample rate of image detector 110. is 
illustratively high enough, again base;d oh the 
20 expected maximum velocity of the mouse, that mouse. 42 
. cannot be moved one full grid spacing before a new 
image is taken. In one illustrative embodiment; 
control component 124 assumes a; predetermined, 
constant distance between grid lines. In that way, 
25 control component 124 simply needs to track the number 
of grid lines which pass through sample area 125, and 
the direction of movement oi those grid lines, in 
order to determine the distance and direction which 
mouse 42 has moved relative to surface 116. Of 
30 course, this is illustratively carried out for grid 
lines in both the X and Y directions. Control 
component 124 then generates a mouse packet, similar 
to that illustrated in FIG. 2B, which is indicative of 
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the movement of mouse 42 relative to surface 16. 

VARIABLE RESOLUTION OPERATION 
FIG- 6 illustrates a mouse pad, or surface, 116 
having four different zones 140, 142, 144 and 146 
5 disposed thereon. Zone 140 on surface 116 has no 
predetermined pattern thereon. Section 142 has a grid 
line pattern of uniformly spaced grid lines. Zone 144 
has a high resolution grid line pattern in which the 
grid line are uniformly spaced, but are spaced closer 

10 than those in zone 142. Zone 146 also has a grid line 
pattern, but the pattern in non-orthogonal in that the 
spacing between the grid lines varies from one side of. 
zone 146 to another side of zone 146. Zones 140-146 
allbw mouse 42 to operate in a variable resolution 

15 . mariner without the need for changing a device driver, 
and without invoking a control panel applet. 

When mouse 142 is over zone 140, control 
component 124 provides position information based on 
random (or in any case non-predetermined) patterns as 

20 . discussed above. In other words, control component 124 
takes iperiodic "snapshots" of patterns or images 
identified within sample area 125 based on surface 
roughness in zone 140, and determines movement of 
those images . relative to sample area 125 to provide 

25 position information. 

However, when mouse 42 is moved over resolution 
zone 142, control component 124 identifies thie grid 
line structure beneath mouse 42 . Since the grid lines 
■ are illustratively far more pronounced than the 

.30 surface roughness of surface 116, control component 
124 can easily identify that mouse 42 is over a zone 
which has a predetermined pattern thereon. Thisrefore, 
when mouse 42 is over zone 142, control component 124 
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simply processes the images as . discussed above with 
respect to FIGS. 5A and 5B, counting the grid linies 
along both axes which pass through sample area 125, to 
determine movement of mouse 42. 
5 Similarly, when mouse 42 is moved over high 

resolution zone 144, control component 124 can quickly 
determine that mouse 42 is over a zone having a 
predetermined pattern thereon, and operates in the 
mode discussed with respect to zone 142. Recall that . 

10 control component 124 is configured to assume a 
predetermined distance between grid lin^s. While grid 
lines in zone . 144 are uniformly spaced, they are 
spaced much closer than those in zone 142 (e.g., the 
grid lines in zone 144 have a spacing, which is half 

15 that of the grid lines in zone 142). Control, 
component 124 is simply counting the number of lines 
which pass through sample area 125. Therefore, for a 
given amount of movement of mouse .42 relative to zone 
144, control component 124 will provide position 

20 infoiination indicating that mouse 42 has moved twice 
as far as the same amount of relative movement of 
mouse 42 with respect to zone 142. By simply moving 
mouse 42 from zone 142 to zone 144, the user can 
effectively half the scale of mouse 42 and double its 

25 resolution, without changing any software and without 
accessing the control panel. 

Zone 146 also has a grid pattern disposed 
thereon. Howiever, unlike zonias 142 and 144, the 
spacing between the grid lines in zone 146 varies 

30 across the zone. As illustrated in FIG. 6, the 
spacing of the grid lines in a central region of zonia 
146 is the largest, while the spacing between the grid 
lines on either end of zone 146 (and top to bottom) 
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decreases toward the edges of zone 146. As described 
with respect to zones 142 and 144, contrbl component 
124 detects that mouse 42 is over a region having a 
predefined pattern thereon. The resolution and scale 
5 of mouse 42 changes as it is moved across zone 146, 
based upon the change in the spacing of the grid lines 
in zone 146. Therefore, the user can convert mouse 42 
into a variable scale and variable resolution input 
device simply by placing the mouse over zone 146, 
10 again without making any changes to the device driver 
and without invoking a control panel applet. 

DETECTION OF SPECIALLY CODED IMAGES 
Controller 112, in conjunction with image sensor 
110, is illustratively configured to detect 
15 substantially any image on surface 116, whether it is 
a predefined image, or a random image indicative of 
surface roughness. Therefore, mouse controller 112 
and image detector 110 can ailso detect specially coded 
images, which have a special meaning, and which are 
20 disposed on surf ace 116. 

FIG- 7 illustrates a very simple coded pattern 
which can be repeated in a given zone on surface 116. 
In one illustrative embodiment, the coded patterns 
■', are identified by control component 124 using a simple 
25 projection technique illustrated in FIG. 8. The array 
of pixels in image sensor 110 can be cpht rolled to 
provide an output which represents a sum of fhe active 
pixels in each row, and in each colutiin. This 
iniEormation is projected on the XY axes as illustrated 

3d in FIG. 8 . 

In other words, the pattern illustrated in FIGS. 
7 and 8 is an inverted triangular pattern which, when 
reflected on the detector array, activates three 
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pixels at its base and, one at its inverted pinnacle 
end* The pattern can be projected onto a single axis 
and represented by a voltage signal 150 on the X axis 
and a voltage sig[nal 152 on the Y axis. Signal 150 
5 has a first level 154 which is indicative of no active 
pixels in the viewing area. Signal 150 also has a 
second level 156 which is indicative of a single 
active pixel in the viewing area. Further, signal 150 
has a third level 158 indicative of two active pixels 

iO in the viewing area. Thus, signal levels 154, 156 and 
158 represent a sum of the signals generated by the 
active pixels, associated with the image, when 
projected on the X axis. 

Signal 152 illustrates projection of the image 

15 onto the Y axis. . Signal 152 has a first level 160 
which is indicative of three active pixels and second 
and third levels 162 and 164 which are indicative of . 
two active pixels, and one active pixel, respectively. 
Upon receiving these digitized signals, control 

20 component 124 identifies the coded pattern and 
provides it to, matching component 166. Matching 
component 166. accesses an image table 128 which stores 
data indicative of all coded images which can be 
recognized by controller 112 . Matching componeht 126 

25 uses any suitable, and preferably simple, matching 
algorithm to match the image identified by control 
component 124 to a predetermined coded image stored in 
image table 128. Illustratively, image table 128 not 
only stores data indicative of the . images to be 

30 recognized but also includes a value associated with 
the recognized image,: and which can be used in the 
mouse packet generated by control compbne^nt 124 in 
. passing the desired information back to computer 20 . 
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In order to generate the mouse packet, control 
component 124 preferably generates a new mouse packet 
generally illustrated by the number 170 in FIG. 9. 
Packet 170 is similar to packet 66 illustrated in FIG. 
5 2B, except that it includes an additional byte 172 of 
information. Byte 172, as with the other bytes in 
packet 170, preferably includes eight bits of 
information which are used to encode the fact that 
control component 124 has, indeed, recognized a 
10 predetermined image which resides in image table 128, 
and which also includes the value in image table 128 
associated with the coded pattern which has been 
identified. . 

By way of example, \the coded pattern illustrated 
15 . in FliS. 7 can be repetitively disposed on surface 116 
to indicate that computer 20 is to operate in a 
certiaih m6dei> or is to change modes. In one 
.. illustrative embodiment , when the coded pattern 
illustrated in FIG. 7 is detected, a function/mode 
20 change value associated with that pattern in image 
table 128 indicates that computer 20 is to operate in 
a vision impaired mode, in which all fonts are 
dramatically increased in size, above a nominal level. 
FIGSf. lOA arid lOB depict a flow diagram 
25 illustrating the operation of mouse 42 and computer 20 
under such circumstances. First, the user manipulates 
the mouse as indicated by block 174. In other words, 
the user simply moves or places the mouse . oyer a 
region or zone of surface 116 which contains the 
30 repetitive coded patterns. Next, image sensor 110 
detects the image and passes the data indicative of 
the detected image to control component 124. Control 
component 124 then identifies the image, as discussed 
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above, and passes, the image to matching component 126. 
This is indicated by blocks 176 and 178. 

Matching component 126 accesses image table 128 
and matches the identified image (if possible) to. an 
5 image contained in image table 128. This is indicated; 
by block 128. Matching table 126 then passes the 
function/mode change value associated with the matched 
image from image table 128 to control component 124. 
Control component 124, in turn, generates the mouse 
10 packet with the function/mode change value contained, 
in byte 5 of the packet. This is indicated by block 
■ 182. 

Control component 124 then passes the packet to 
serial interface 46, as indicated by block 184. 

15 Serial interface 46 converts the serial mouse packet 
into parallel mouse packet information and provides 
that information to mouse driver 60. Mouse driver 60 
examines the information in byte 5 and creates a mbuse 
message based on the function/mode change information 

20. which is in turn based on the predetermined coded ; 
pattern which has been identified. This is indicated 
by blocks 186 and 188. Mouse driver 60 passes the 
mouse message to operating system 35, as indicated by 
•block 190-, ■, 

25 It should be noted that the mouse message can be 

a specialized message intended for the operating 
system. For example, in order to operate in a vision 
impaired mode, the mouse message may indicate to the 
operating system that the font size needis to be ^ 

30 increased. Determination of whether mouse message is 
a specialized message is indicated by block 192. ; If 
the mouse message is a message intiended for the 
operating system, the operating system takes the 
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necessary steps to change the operating mode of 
computer 20, based upon the information in the mouse 
mesisage. This is indicated by block 194. In the 
instance where computer 20 is to change to a vision 
5 impaired mode, the operating system invokes a control 
panel change of the font size to a desired level, such 
as by calling an API. The operating system then 
conisumes the mouse message. This is indicated by 
blocks 194 and 196. 

10 If/ at block 192, it is determined that the mouse 

message is not a specialized message intended for the 
operating system, the operating system simply passes 
the mouse message to registered mouse message hooks. 
This is indicated by block 19^. The message hook may 

15 be registered by an application which is configured to 
utilize the information contained in the mouse 
message. Such information may, for example, indicate 
that a command is to be passed, to the application 
which owns the window currently under focus in 

20V computer 20. Therefore, the message hook executes by 
identifying the focus, as indicated by blocks 200 and 
202. The message hook then issues the desired command 
to the f ociis application and consumeis the mouse 
message. This is indicated by blocks 204 and 196. 

25 While the above discussion has proceeded with 

respect to chianging the operating mode of computer 20 
from a normal Visibh mode to a vision impaired mode, 
the; present : technique . can be used .to make 
substantially any changes to the operating mode of 

30 computer 20. Change of font size is but one example. 
It should also be noted that, while mouse 42 can 
identify coded images oh surface 116, - it can 
simultaneously provide, position information based 
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either on movement of the coded images within sample 
area 123, or based on movement of images created by 
the surface roughness of surface 116 within sample 
area 123, both of which are described above. In that 
case, mouse packet 170 not only includes information 
contained in byte 5, but also includes position 
information indicative of the movement of mouse 42 in 
the X and Y directions. Of course, mouse 42 can also 
simultaneously provide information in packet 170 which 
is indicative of the actuation of buttons arid the 
rotation of the wheel on mouse 42. . 

Further, mouse pads are illtistratively used which 
contain different coded messages on opposite sides 
thereof. In other words, the impaired vision code can 
be provided on one side of the mouse pad, and repeated 
across the entire sxirf ace of the mouse pad, along with 
grid lines having various zones such as those shown in 
FIG. 6. In that instance, a single side of the mouse 
pad provides an indication to computer 20 that it is 
to operate in the vision impaired mode, and also 
provides the user with the variable resolution 
capability discussed above with respect to FIG. 6. At 
the same time, the opposite side of the. mouse pad can 
contain the same variable .resolution zoiie^ (or any 
other suitable pattern) . without the vision impaired 
coded symbols thereon, Thus, if the user is vision 
impaired, the User can simply flip over the mouse pad, 
place mouse 42 on the pad, and computer . 20 will 
automatically switch to a visipn impaired mode. 

The present invention can also iae used to 
accompiish other desired functions. For example, 
mouse, 42 can also be used as user input device for 
inputting a user ID or password to perform a. logon 
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operation. FIG. 11 is a block diagram similar to that 
shown in FIG. 4 , and similar items are correspondingly . 
numbered. However, FIG. 11 illustrates a different 
image -210 which is disposed on surface 116. In the 
5 embodiment illustrated in FIG. 11, image 210 is 
illustrated as a barcode. However, any other 
recognizable image can be used. Image 210, in one 
embodiment. Is placed on a" personalized mouse pad, or 
an ID badge which a user carries for security. 
10 purposes, or on another similar personalized item. 

In some conventional computer systems, a logon 
procedure is required before the user is permitted 
access to certain aspects of the computer system. When 
a computer is booted up, the boot -up sequence may 
15 require the operating system to call a logon 
application which generates a user interface requiring 
the user to input identifying informationV such as a 
name or ID number, as well as a password. Based on 
: this user input information, the logon application can 
20 allow the user full access of the computer system, 
only partial access (where different levels of 
security are implemented) , or no access at all (such 
as where the user input information reflects that the 
user is not authorized to have any access to the 
25 system) . 

For example, some financial or billing system 
applications only allow authorized users to have 
access to certain data bases containing confidential 
financial information. Similarly, in a network 
30 environment, some logon applications will control 
access to the network drives based on the user's 
identity and . security level . Further , automatic logon 
procedures implemented . in systems utilizing the 
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••WINDOWS" brand operating systems require the user to 
; reboot the computer (such as by executing the CTL-ALT- 
DEL key sequence) before the logon procedure will be 
executed. Such logon operations can be somewhat 
5 cumbersome . 

Theirefore, the present invention provides a 
system by which logon can be accomplished simply by 
placing mouse 42 over a coded image which contains the 
user's personal logon information, or by sfcanning 
10 mouse 42 across an image (such as the barcode 
illustrated in image 210) which encodes the user !s 
personal logon information. 

Where the coded image is small enough that it can 
be recognized by controller 112 without moving mouse 
42 (i.e., where it is small enough that it will appear 
within viewing area 123 in its entirety, the image is 
simply processed a? . . any other coded image, as. 
(iescribed above. In other wbrds, the image is captured 
by image detector lid, provided to A/D converter 122 
which converts the image signal into a digital signal , 
and is passed to control componerit 124 . Control 
component 124 then identifies the image and provides, 
it: to matching component 126 which . matches the 
identified image to a corresponding image stored in 
25 image table 128. In that instance, image table i2 8 
also includes, an associated image value which 
identifies the image as a user's logon information. . 

This information is provided back to control 
component 124 which generates the mouse packet and 
provides this mouse packet, through serial interface 
46, to mouse driver 60, Mouse driver 60, in turn, 
generates a mouse message which is transmitted to 
operating system 35. In an embodiment in which 
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operating system 35 handles logon operations, * the 
mouse message is designated as a specialized mouse 
message for operating system .35. In another 

embodiment in which a separate application handles the 
5 logon procedures, the mouise message is simply 
designated as a normal mouse message which is to be 
passed to registered message hppk procedures 62. In 
that case, operating system 35 passes the mouse 
message to the message hook procedures until it 
10 reaches the logon application. . The logon application 
issues commands to other components of computer 20 to 
configure computer 20 to allow a desired level of 
access to the user, or to deny the user access and 
simply issue an error message to the user. 
15 In an embodiment in which mouse 42 is scanned 

across image 210 (such as where image 210 is a 
barcode) operation is generally; indicated by the flpw 
diagrams illustrated in FIGS. 12A and 12B/ It is 
worth noting at the outset that mouse 42 can be ^ 
20 configured to receive a select input from the user 
(such as depression of one of the buttons) indicating 
that the user wisheis to enter a logon mode. 

The user then scans mouse 42 across image 210 as 
indicated by block 212. By scanning mouse 42 across 
25 image 210, a sequence of discrete images will be 
generated which are indicative of the information 
encoded in barcode image 210. image detector 110 
captures this image sequence and provides it, in turn, 
to A/D converter 122 which provides digital 
30 information representative of the image sequence to 
control compbrient 124. This is indicated by block 

• 214. - ' ■ ■ ' ^ - • •■ ; . /. 

Control component 124 identifies each image in 
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the sequence of images, as indicated by block 216 and 
provides the sequence of images to a matching 
component 126. Matching component 126 matches the 
image sequence to an image sequence stored in image 
5 table 128, as indicated by block 218. Control 
component 124 receives the associated information from 
image table 128 and generates the mouse packet 
including logon information associated ; with the 
matched image sequence. This is indicated by block 

10 220. Control component 124 passes the mouse packet to \ 
serial interface 46 as indicated by block 2|22 . Serial 
interface 46 then converts the serial mouse packet 
into parallel mouse packet information and provides 
the parallel mouse packet information to mouse driyer 

15 60, as indicated by block 224. 

Driver 60 creates a mouse message based on the 
logon event information received, as indicated by 
block 226, and passes the mouse message to operating 
system 35 as indicated by block 228. In the 

20 embodiment in which the logon procedures are to be 
handled by an application separate from operating 
system 35, the logon application must have already 
registered itself with the operating system 35 as a 
mouse message hook. This is indicated by block 230. 

25 Operating system 35 thisn passes the mouse message 

to a next registered mouse message hook as indicated 
by block 232 and the message hook procedures are / 
executed as indicated by block 234. In one 

illustrative embodiment, the message hook simply 

30 issues commands to the logon application requesting 
that the logon application verify the identification 
and password information in the mouse message. This 
is indicated by block 236. Commands are then issued 
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from the logon application which configure computer 20 
to allow appropriate access to the user. This is 
indicated by block 238. The message hook associated 
with the logon application then consumes the mouse 
5 message as indicated by block 240. It should be noted 
that, while the above discussion has proceeded with 
respect to a logon operation, those skilled in the art 
will recognize that a technique implemented according 
to the present invention can be used to perform any 
10 other desired functions, or to issue commands to any 
other applications, as well. 

GENERATION OF CUSTOM TEMPLATES 
The present invention can also be used to 
generate custom templates, or printed surfaces, 116 
15 which include customized coded images thereon 
(printed on paper, Mylar, etc.) which act to 
customize the system for a specif ic user or a specific 
need. For example, some game applications expose 
additional functionality aa the user reaches . higher 
20 levels in the game. In other words, as the user 
reaches a certain score, or traverses a certain 
• screen, the game application provides additional. 

"lives" or. "ammunition" or provides the user with 
. acdess to additional "weapons" of other tools or 
25 instruments which can be used in the game. Similarly, 
in some such applications, after the user reaches a 
certain level, the application triggers a different . 
/ . response through the utilization of an existing tool 
or implement. The present invention can be used to 
30 enhance the functionality of such games. 

In order to enhance functionality, the , 
application is configured to print out a customized 
template for placement on surface 116. The template 
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includes customized encoded images which are read by 
mous^ 42 and result in the creation of a mouse message 
which is interpreted by the application to modify the 
functionality of the application. This process is 
5 generally indicated by the flow diagram set out in 
FIG. 13. 

First, the application receives a trigger event 
to print a new customized template contaiining the 
custotnized encoded images. This is indicated by block 

10 242. As discussed above, this event can simply be 
that the user reaches a predetermined level in a game.; 

The trigger event can also correspond to the user 
entering or scanning in a secret code which has been 
revealed by the application to the. user- In the 

15 embodiment in which the user scans such a secret code 
with mouse 42, the code is transmitted to the 
application using (for example) the protbcpl 
identified above with respect to FIGS, 1 OA and lOB. 

The application then issues commands to print out 

20 the appiication specific, customized template . This 
iis indicated by block 244 ; ; Also / of course , . the 
application must register any: other required mouse 
message hooks with operating system 35, such that it 
will receive mouse messages containing information 

25 indicative of the customized coded images on the new 
template. This is indicated by block 246. The new 
template is then placed on surface 116 and used by the 
. ■ user." 

It should be noted that while the above 
30 discussion has . proceeded with respect to a games 
application, the invention is not so limited. Those 
skilled in the art will recognize that the invention 
can be utilized ; to print out any template which is 
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customized to an application, regardless of the . 
application in which it is used. 

USE OF A MOUSE 42 AS AN ABSOLUTE POSITION DEVICE 
The present invention can also be utilized to 
5 selectively convert mouse 42 from a relative position 
device to an absolute position device.. This is 
illustrated in FIG. 14. FIG. 14 illustrates mouse pad 
or template 248 which has three separate zones 250, 
252, and 254 disposed thereon. In one embodiment , 
10 zone 250 either has no predetermined pattern thereon, 
or has a grid structure pattern, or other similar 
pattern such as that described with respect to FIGS. 
5A and SB. Thus, when mouse 42 is over zone 250, it 
simply acts as a relative positioning device. 
15 Zone 252 has a repetitive code disposed thereon. 

In other words, zone 252 has a number of cells 256, 
each cell containing the same coded symbol 258. ^ The 
repetitive coded area in zone 254 can be used, as 
discussed above, to place computer 20 in a desired ^ 
20 mode of operation, and can also be uised to generate 
relative position information corresponding to, 
mdvement of : mouse 42 over zone 252 . 

However, template 248 also includes zone 254 
which contains a plurality of cells 260, each eincoded 
25 with a unique coded image 262. Since each coded image 
. 262 in cells 260 is different from the other encoded 
images 262 in other cells 260, placement of mouse 42 
over zone 254 can be used to convert mouse 42 into an 
absolute positioning device. 
30 Each of the unique coded images 262 are stored in 

image table 128. Each of the coded images also has a 
value associated therewith (in image table 128). which 
is. indicative of an absolute position of mouse 42 
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within zone 254. Therefore, when a coded image 262 is 
identified by control component 124, it is passed to 
matching component 126 which matches the coded image 
to a corresponding image in image table 128. Image 
5 table 128 then provides the absolute position 
information to control component 124 which generates, 
the mouse placket passed to computer 20, incltiding the 
absolute position information. This absolute position 
information can be used to place a cursor on the 

10 display screen of computer 20 at a predefined position 
which corresponds to the absolute . position 
information, regardless of the relative movement of 
mouse 42. In that way, mouse 42 can be picked up, off 
of template 248, and set down at another location 

15 within zone 254. The cursor will then be moved, to 
another position on the display screen corresponding 
to the eQDSolute position read from zone 25i4 over which 
the mb\ise is then placeid. 

GENERATION OF IMAGES IN IMAGE TABLE 128 

20 It will be appreciated that; prior to matching 

identified images to images which r^^side in image 
table 128, the images must be somehow generated and 
placed in image table 128. FIGS. ISA, 158 and 16 ; 
illustrate a number of embodiments for accomplishing 

25 this . ' 

At the outset, the images can be preformed images; 
which are simply loaded into computer 20. The 
preformed images are then downloaded to control 
component 124 in controller 112 which places the 
30 images in image table 128. Downloading the images can 
be accomplished using any suitablie protocol. . For 
example, an image loading component in computer 20 can 
access the preformed images stored, in computei: 20 arid 
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generate image packets which are passed to operating 
system 35. In that instance, mouse driver 60 is 
provided with an image packet transmission component 
which receives the image packets from operating system 
5 35 and provides them in parallel, to serial interface 
.46- Serial interface 46 then serializes the packets-, 
and provides them, through a suitable link, to control 
component 124 which simply places the images in image; 
table 128. These images are then used by matching 
10 component 126 in matching images captured by image 
detector llO and identified by control component 124 . 

While the preformed images can take substantially 
any form, iii one illustrative embodiment, they are 
orientation compensating codes . For instance, the: 
15 codes will be recognizable by control component 124, 
regardless of the angular orientation of mouse 42, in 
the plane oif surface 116 oyer which it is disposed. 
Therefore, if the user slightly rotates mouse 42 in 
the plane of surface 116 as the user moves mouse 42 
20 rjelative to surface 116, the coded image will be 
Constructed such that it can be identified regardless' 
of the patticul^r orientation of mouse 42. 

FIG. 15B is/one illustrative embodiment of such a 
coded, image. FIG. iSB shows a coded image 264 which 
25 contains a pair of concentric circles 266 and 268, and 
an orientation marker 270. Image 264 also contains a 
plurality of coded image cells 272 which contain 
• information indicated by a coded message 264. -.When 
the image signals indicative of image 264 are provided 
30 to control componejit 124, control component 124 uses a 
simple algorithm to identify concentric circles 266 
and 268, aiid marker 270. Based on the location of 
marker 270, control component 124 can easily determine 
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the orientation of image 264 relative to mouse 42, and 
can then proceed to examine the remainder of image 264 
for the information in cells 272. 

While a wide variety of such orientation 
5 compensating codes can be used/ and while orientation 
compensating codes do not riecesisarily need to be used 
in all embodiments of the present invention, some such 
orientation compensating codes are commercially 
available and are designated by the term USS-MaxiCode 
10 system. Codes utilizing this system also exhibit 
certain fault tplerance characteristics whiqh may be; 
desirable. 

Not only can the coded images be preformed and 
downloaded from computer 20 to mouse 42, but they can 

15 be learned by computer system 20 and mouse 42 as well. 
FIG. ISA is a functional block diagram illustrating 
computer 20. FIG. 15A is similar to FIG. 2A/ and 
similar items are coixespondingly numbered. However, 
FIG. 15A illustrates that computer 20 is also provided. 

20 with a learn mode component 274 . Learn mode component , 
2*74 is illustratively associated with a learn mode 
application which has registered a message hook with 
operating system 35. 

FIG. 16 is a flow diagram illustrating operation 

25 of mouse 42 and computer 20 in the learn mode. First, 
the user initiates the learn mode. This can be done 
simply by placing the mouse over a preceded pattern on 
the mouse pad, by depressing an actuator iDUtton on the . 
mouse, by depressing a key or key sequence on the 

30 keyboard, etc. In response to learn mode initiation, 
operating system 35 calls learn mpde component 274 
which provides a user interface to the user indicating 
the particular function or mode change which is to be 
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assigned to the next coded image which is captured by 
mouse 42 and learned. Initiation of the learn mode in 
specifying the function/mode change is indicated by 
blocks 276. and 278 in FIG. 16. 
5 The user then scans the mouse over a selected 

area on surface 16 which contains the coded image to 
be captured. Alternatively/ the user can simply set 
the mouse 42 on that area, if the coded images are 
repeated on surface 116 and are spaced closely enough 

10 together that, no matter where the user sets mouse 42, 
at least one of the coded images will be captured by 
image detector 110. This is indicated by block 280. 

The images are then captured by image detector 
110 and image data indicative of the image is provided 

15 by control component 124 in mouse 42. A mouse packet 
is transmitted to serial interface 46 and • to mouse 
driver 60 where a mouse message carrying the image 
data is generated and provided to operating system 35. 
This is indicated by blocks 282 and 284. Operating 

20 system 35 transmits the mouse message to message hook 
procedures which have registered with operating system 
35, such that the. mouse message will eventually be 
provided to learn mode component 274. This is 
indicated by block 286. 

25 Learn mode component 274 characterizes the image 

by assigning a pattern key or pattern signature key to 
the image which can be used by control component 124 
in identifying the image, and by matching component 
126 in matching the image to other images istored in 

30 image table 128. This lis indicated by blocks 286 and 
288. ; Learn mode component 274 then associates the 
pattern key generated with a value . indicative of the 
function or mode change which is to be represented by 
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the coded image. This value is associated with the 
image key to form an image table entry for entry in 
image table 128 in mouse 42. this is indicated by 
block 290. . 

5 The image tablei entry is then transmitted back to 

mouse 42 using any suitable protocol, such as that set 
out for sending preformed coded images to mouse 42 
from computer 20. This is indicated by block 292. 
The image table entries which are sent to mouse 42 are 
10 also sent to a memory location oh computer 20 such . 
that they can later be downloaded to another mouse 42, 
for example, when one mouse is switched for another 
mouse during the operation of computer 20. 

It should be noted that, while the present 
15 discussion of the learn mode has proceeded with 
respect to only capturing a single image to be 
associated with a given function, other methods could . 
be used as well. For example, the learn mode component 
can instruct the user to again place the mouse over 
20 the same coded image to be learned such that two 
instances of the same coded image can be c<aptured. 
The two instaiices are then averaged by learn mode 
component 274 in order to obtain an average value 
indicative of the coded message to be learned. This 
25 process is illustratively repeated a number of times 
in order to help reduce the affects of noise, or other 
anomalies, on the image capturing process. \ 

CONCLUSION 

It can thus be seen that the present invention 
30 proyidles a mechanism by which pattern information can 
be provided to a computer. The pattern inforTtiation 
can be used by the, computer for a wide variety of 
purposes. The computer . cain be configured such that 
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operational characteristics of the computer can be 
changed based on the pattern information. The 
operational characteristics can represent 

siibstantially aiiy change in how the computer operates. 
5 The change in operational characteristics can be 
referred to as a change event generated based on 
images, (which include partial images or patterns) 
read from surface 116. The change event can reflect, 
for example, changes in behavioral characteristics of 

10 the computer input device, operational modes of the 
computer to which it is attached, operational 
characteristics of. the operating system of the 
computer, commands to applications, or the input of 
user identif iciatipn information. Since the change 

15 , event is generated and provided to computer 20 based 
on what is "read" from a template or pattern provided 
on surface 116 by an optical tracking device, such as 
a mouse, the present invention overcomes significant 
disadvantages associated with prior systems in which 

20 software drivers or control panel applets were 
. required to be manipulated or invoked in order to make , 
such changeS:. 

Although the present invention has been described ^ 
, with reference to preferred embodiments, workers 
25 skilled in the art will recognize that changes may be 
made in form and detail without departing from the 
spirit and scope of the invention. 
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WHAT IS CLAIMED IS; 

1. A computer input system for providing . input 
information to a computer, comprising: 

a computer input device configured to provide 

position information based on a. position of 
the computer input device relative to a 
surface, the computer input device 
comprising a pattern detector configured to 
detect a pattern on the surface and a 
controller coupled to the pattern detector; ; 
and 

.a pattern disposed on the surface, the pattern 
. having at least first and second 

predetermined pattern portions thereon, the 
controller generating a change event based 
on the pattern detector switching between 
detecting the first predetermined pattern 
portion and detecting the second 
predetermined pattern portion. 

2. The computer input system of claim 1 wherein the 
controller is configured to generate the change event 
by providing change information to change operating 
characteristics of the computer input device. 

3. The computer input system of claim 2 wherein the 
controller is configured to change the position 
information provided for a given distance of relative 
movement of the computer input device with respect to 
the pattern, based on whether the pattern detector is.- 
then detecting the first or second predetermined 
pattern portion. 
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4. The computer input system of claim 3 wherein the 
first predetermined pattern portion comprises a first 
plurality of predetermined images spaced a first 
distance apart and wherein the second predetermined 
pattern portion comprises a second plurality of 
predetermined patterns spaced a second distance apart . 

5 . The computer input system of claim 4 wherein the 
first plurality of predetermined images comprises a 
first plurality of grid lines spaced the first 
distance apart and wherein the second plurality of 
predetermined images comprises a second plurality of 
grid lines spaced the second distance apart. 

6. The claim 3 wherein the first predetermined 
pattern portion comprises a first plurality of 
predetermined images spaced from one another by a 
distance which varies across the pattern. 

i. The computer input system of claim 2 wherein the 
controller is configured to provide relative position 

; information indicative of relative movement of the 
computer input device relative to the pattern when the 

: image detector is detecting the first predetermined 
pattern portion and absolute position information 
indicative 6f an absolute position of the computer 
input device with respect to the pattern when the 
image detector is detecting the second. predetermined 
pattern portion. 

8. The computer input system of claim 7 wherein the 
second predetermined pattern portion comprises a 
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plurality of unique predetermined images spaced from 
one another on the surface . 

9. The computer input system of claim 1 wherein the 
surface comprises: 

a first surface portion on a first side of a 

substrate and having the first predetermined 
pattern portion disposed thereon; and 

a second surface portion on a second side of the 
substrate and having the second 
predetermined pattern portion disposed 
thereon. 

10. The computer input system of claim 1 wherein the 
controller is configured to generate the change event 
by providing the input information to the computer 
wherein the input information includes change 
information for changing operating characteristics of 
the computer. 

11. The computer input system of claim 10 wherein the 
change information comprises mode change information 
indicative of a desired, change in operating modes of 
the computer and wherein the controller provideis the 
mode change information based on the image detector 
switching between detecting the first predetermined 
pattern portion and the seconid predetermined pattern 
portion. 

12. The computer input system of claim 11 wherein the 
first predetermined pattern portion comprises at least 
one predetermined image indicative of a first computer 
operating, mode. and wherein, the second predetermined 
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pattern portion comprises a second predetermined image 
indicative of a second computer operating mode. 

13 • The computer input system of claim 1 wherein the 
controller is configured to generate the change event 
by providing the input information to the computer 
wherein the input information includes command 
information for issuing a command to an application 
running on the computer, the controller generating the 
command information based on the image detector 
detecting at least one of the first and second 
predetermined pattern portions. 

14. The computer input system of claim 13 wherein the 
application comprises a logon application and wherein 
the command information is indicative of a logon 
command and user authentication information, the logon 
application controlling access provided to a useir 
based oh the logon command and the user authentication 
information. 

15. The conputer input system of claim 14 wherein the 
surface comprises a portion of a user identification 

... badge. 

16. The computer input system of claim 1 wherein the 
first and second predetermined pattern portions are 
learned patterns which are learned by the controller 
in rei^ponse to initiation of a learn mode of 
operation. 

17. . The computer input system of claim 1 wherein the 
controller is houseci within the computer. 
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18; A method of providing a liser input to a computer, 
the method comprising: 

placing a user input device over a first portion 
. of a surface having a first predetennined 

pattern disposed thereon; 
detecting a first image indicative of the first 

predetermined pat tern ; 
providing first pattern information to the 

computer indicative of detection of the 

first images- 
placing the user input dievice over a second 

portion of the surface having a second 

predetermined pattern disposed thereon; 
detecting a second image indicative of the seicond 

predetermineid piattern; and 
providing second pattern information to the 

computer indicative of detection of the 

second imaged 

19. The method of claim 18 and further comprising: 
controlling the computer based on the first and 

. second pait tern information. 

20. The method of claim 19 wherein controlling 
comprises: 

changing one of ah operating parameteir of the 

user input device, and an operational mode 
of the computer; based on a change from 
detecting the first image to detecting the 
second image . 



21. The method of claim 19 wherein the controlling 
step comprises: 
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changihg a mode of operation of the computer 

based on a change from detecting the first 
image to detecting the second image. 

22. The method of claim 21 wherein the step of 
detecting a first image comprises: 

capturing the first image with an image detector ; 
and 

matching information indicative of the^ first 

image to information indicative of a first 
stored image stored in an image store . 

23. The method of claim 22 wherein the step of 
changing a. mode of operation, comprises: 

- providing a modie value associated with the first 
stored image, the mode value being 
indicative of a first mode of operation of 
Lue. computer. 

24 . The method of claim 21 wherein the step of 
detecting a second image comprises: 

capturing the second image with an image 

detector; and 
matching information indicative of the second 

image to information indicative of a second 
stored image stored in ah image store. 

25. The method of claim 24 wherein the step of 

changing a mode of operation, comprises: 

providing a mode value associated with the second 
stored image, the mode value being 
indicative of a second mode of operation of 
the computer. 
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26. The method of claim 19 wherein the controlling 
step comprises : 

changing an operating parameter of the user input 
device. 

27. The method of claim 26 wherein the user input 
comprises position information indicative of movement 
of the input device relative to the surface and 
wherein the controlling step comprises: 

changing the position information output by the 
usigr input device for a given distance of 
movement of the user input device relative 
to the surface based on whether thia user 
input device is moving over the first 
portion of the surf ace or the second portion 
of the surface. - 

28. The method of claim 26 wherein the user input 
comprises position information indicative of movement 
of the input device relative to the surface and 
wherein the controlling step comprises: 

changing the position iniEormation associated with ; 
a given.distance of movement of the usisr 
input device relative to the. surf ace based 
on a change from detecting the first image 
to detecting the second image. 

29. The method of c la; im 26 the user input comprises 
position infonhation, and wherein the controlling step 
comprises: 

changing the position information from relative 

ppsition information indicative of . moyemerit 
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of the user input device relative to the 
surface to absolute position information 
indicative of an absolute position of the 
user input device with respect to the 
surface, based on whether the user input 
device is detecting the first image or the 
second image. 

30. A data structure passed from a computer pointing 
device to a computer, comprising: 

a first data portion indicative of movement of 
the pointing device relative to a surface; 

a Wecond data portion indicative of actuation of 
an actuation button on the pointing device; 
and 

a third data portion indicative of a 

predeteiinined optical image detected oh the . 

"surface. 

31. The data structure of claim 30. wherein the third 
data portion comprises operational characteristic, 
information usable by the computer to change 
operational characteristics of the computer. 

32. The djata structure of claim 31 wherein the third 
data portion compriseis mode information useable by the 
computer to change operating modes. ^ 

33. The data structure of claim 31 wherein the third 
data portion comprises command information indicative 
of a command to be issued to an application residing 
on the computer. 
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34. The data structure of claim 33 wherein the third 
data portion comprises information related to a logon, 
procedure useable by a logon program. 

35. A method of controlling a computer, comprising: 
providing a computer input device moveablie 

relative to a surface; 
detecting an optical pattern on the surface with 
the computer input device; and 
configuring the computer to operate according to 
operational characteristics based on the 
optical pattern detected on the surface. 

36. The method of claim 35 and further comprising: . 
providing position information to the computer 

based on movement of the computer input 
device relative to the siafface. 

37. The method of claim 36 wherein the step of 
providing position information comprises: 

detecting a non-predetermined i^age on the 

■ surface ; . . - * 

moving the user input device relative to the 

surface; and 
detecting a change in relative position 6f the 

non-predetermined image relative to the user 

input device. 

3 8 . A method of controlling a computer based on input 
informatiori provided by a user input device, 
comprising: 

placing the user input device over a surface; 
generating position inforTnatipn based on movement 
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of the user input device relative to the 
surface; 

positioning a display item on a computer screen 
based on the position information generated 
from the input device; 
detecting a predefined optical pattern on the 
surface; and 

issuing a command to an application program 
running on the computer based on the 
predefined optical pattern detected on the 
Sfurface. 

39. A computer input device, comprising: , 

an image detector configured to detect optical 
patterns on a surface; and 

a controller, operably cpupled to the image 

detector to receive indicia of the detected 
. ■ ■ image, the controller including an image 
store storing indicia of predetermined 
images, the controller being configured to 
match the detected image to one of the 
predetermined images and to provide a 
computer input message including information 
corresponding to the predetermined image 
. matched to the detected image. 

40. A method of controlling a computer based on input 
information provided by a user input devic^ useable 
for generating position information based on movement 
of the user input device relative to a surface and 
positioning a display item on a computer screen based 
on the. position information generated from the input 
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.device, the method comprising: 

detecting a predefined optical pattern on a 
surface ; and 

controlling a procedure to log on to the computer 
based on the optical pattern detected. 

41. A computer input device for providing input 
information to a computer, comprising: 

a position transducer configured to provide 

position information based on a position of 
the computer input device relative to a 
surface; 

a pattern detector configured to detect first and 
second patterns on the surface; and 

a controller coupled to the pattern detector and 
being configured to generate pattern ' 
information for transmission to the 
computer, the pattern information being 
indicative of whether the pattern detector 
is detecting the first pattern or the second 
pattern. •■ 

42. The computer input device of qljaim 41 wherein the 
controller is configured to generate a first 
information packet including a pattern portion 
containing first pattern information indicative of the 
pattern detector detecting the first pattern. 

43. The computer input device of claim 41 wherein the 
controller is configured to generate a second 
information packet including a pattern portion, 
containing second.pattern information indicative of 
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the pattern detector detecting the second pjattern. 

44. The computer input device of claim 43 whereiih the 
controller is configured to generate the first 
information packet with the first pattern information 
being indicative of a first plurality of predetermined: 
images spaced a first distance apart and wherein the 
controller is configured to generate the second 
information packet with the second pattern information 
being indicative of predetermined images spaced a 
second distance apart. 

45. The computer input device of claim 43 wherein the . 
controller is conf igureid to generate the first 
information packet with the first pattern information . 
being indicative of a first plurality of images spaced 
from one another by a distance which varies across the 
first pattern. 
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